The Turing Ratio: Metrics For Open-ended Tasks
نویسندگان
چکیده
The Turing Test is of limited use for programs falling far short of human performance levels. We suggest an extension of Turing’s idea to a more differentiated measure the "Turing Ratio" which provides a framework for comparing both human and algorithmic task performance. Games provide an example of the concepts. It is argued that evolutionary computation is a key method for amplifying human intelligence, an assertion which future scientists can empirically decide through measuring Turing Ratios and considering task breadth, prior knowledge, and time series of the measures.
منابع مشابه
The Turing Ratio: A Framework for Open-Ended Task Metrics
The Turing Test is of limited use for entities differing substantially from human performance levels. We suggest an extension of Turing’s idea to a more differentiated measure the "Turing Ratio" which provides a framework for comparing human and algorithmic task performance, up to and beyond human performance levels. Games and talent levels derived from pairwise comparisons provide examples of ...
متن کاملHard to Cheat: A Turing Test based on Answering Questions about Images
Progress in language and image understanding by machines has sparkled the interest of the research community in more open-ended, holistic tasks, and refueled an old AI dream of building intelligent machines. We discuss a few prominent challenges that characterize such holistic tasks and argue for “question answering about images” as a particular appealing instance of such a holistic task. In pa...
متن کاملFour Steps Toward Open-Ended Evolution
In 1998, Bedau et al. de ned a set of metrics for characterizing the long-term evolutionary dynamics of a system. They argued that no known arti cial system demonstrates the unbounded evolutionary activity observed in the fossil record. In response we have developed a series of toy models that approach and eventually succeed in demonstrating unbounded evolutionary activity. The underwhelming su...
متن کاملInformation literacy in public libraries from the perspective of public libraries’ policymakers; an exploratory study
Purpose: The present paper aims to conduct an exploratory study on the status of information literacy in upstream documents and curriculums of Iran public libraries institutions for public libraries. Methodology: This is a developmental exploratory-qualitative study in terms of purpose. Research data were collected using in-depth, semi-structured interviews with policymakers and officials of p...
متن کاملThe Effects of Collaborative Translation Task on the Apology Speech Act Production of Iranian EFL Learners
The present study aims to investigate the relative effectiveness of different types of pragmatic instruction including two collaborative translation tasks and two structured input tasks with and without explicit pragmatic instruction on the production of apologetic utterances by low-intermediate EFL learners. One hundred and fifty university students in four experimental groups and one control ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2002